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ABSTRACT 



The present invention provides a color image processing 
apparatus comprises a virtual device for executing process- 
ing in a reverse direction to that in the color image output 
device in which output color image data in the color image 
output device corresponds to input color image data and 
input color image data therein corresponds to output color 
image data, and a d iscriminating unit for making a deter- 
mination as to whetner input color image data is within a 
color reproduction range of the color image output device 
according to output color im age data from the virtual device . 

26 Claims, 18 Drawing Sheets 



1600 



INPUT 
COLOR 
S I GNAL 



COLOR CORRECTING 
SECT I ON 



OUTPUT COLOR 
S I GNAL 



1601 



OUTPUT SECTION 



PARAMETER 
COMPUTING 
SECTION 



1603 



1604 





OPTIMIZED COLOR 
DECIDING SECTION 




OPERATING 
SECT 1 ON 







03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct. 27, 1998 



Sheet 1 of 18 



5,828,780 




03/15/2004, EAST Version: 1.4.1 



U.S. Patent Oct. 27, 1998 Sheet 2 of 18 




03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct. 27, 1998 



Sheet 3 of 18 



5,828 



FIG. 3 



c 



START 



N PIECES OF CO 
OUTPUTTED FROM 
OUTPUT OEVICE 


LOR SAMPLE ARE 
ACTUAL IMAGE 






COLOR SAMPLE ARE MEASURED 






VP PARAMETERS ARE COMPUTED IN - 
ACCORDANCE WITH MEASURED VALUE 



c 



END 



S301 



S302 



S303 



F I G. 4 




INPUT LAYER 



OUTPUT LAYER 



INTERMEDIATE 
LAYER 1 



INTERMEDIATE 
LAYER 2 



03/15/2004, EAST Version: 1.4.1 



I t 

U.S. Patent Oct. 27, 1998 sheet 4 of 18 5,828,780 



F I G. 5 



LOOP A 
♦ 



c 



START 





S501 n 


IMAGE DATA (RGB OATA) IS CONVERTED 
TO TRI STIMULUS VALUED XYZ 




S502, 


XYZ IS CONVERTED TO L*a*b* 




5503^ 


VALUE FOR c. m. y 
WITH REVERSE DIRE 


ARE COMPUTED 
CTIOHAL VP 



S504 

lETHER ALL Tl 
COMPUTED VALUES FOR c. n. y ARE 
JHIM MEASURED COLOR DENSITY RANI 

OR NOT ? 



SSOS 



res 



IMAGE DATA IS WITHIN COLOR 
REPRODUCTION RANGE 



«*--- 



c 



END 



NO 




S506 x 




IMAGE DATA IS OUTSIDE 


COLOR REPRODUCTION RANGE 



1 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent Oct. 27, 1998 sheet 5 of 18 5,828,780 




F I G. 7 




03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct. 27, 1998 



Sheet 6 of 18 



5,828,780 




S802 > 


NO 


PIXEL (RGB DATA) IS CONVERTED 
TO TRI STIMULUS VALUE XYZ 


S803 p 




XYZ IS CONVERTED TO Lta*bl 


S804 ^ 




COUNTING UP FC 
TO WHICH Ltatb 
EXECUTEO 


R DIVIDED SPACE 
$ BELONGS IS 



S805 



S806 



YES 



COORDINATES FOR SPACE AND 
Ltatb* VALUE SAVED 



S813 



i 



F I G. 8 



YES 





S809 ^ 


YES 


TOTAL SUM IP 


OF ALL PIXELS 


BELONGING TO DIVIDED SPACE 


IS OBTAINED 





SB10 



INCLUDING RATIO 
«*IP/TP(%) 



S311 



NO 




NON-COMPRESSION 
PROCESSING 



S812 v 


YES 


COMPRESSION 


PROCESSING 







c 



END 



) 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct. 27, 1998 



Sheet 7 of 18 



5,828, 




REPRESENTATIVE POINT (LA. al. bi ) 
OF DIVIDED SPACE IS L I NEARLY 
COMPRESSED TO POINT (Lg, aO, bO) 
WHEN COMPRESSION RATIO IS ke 

L2=L-(L-Lg)(1-ke) 

a2*(1-ke)a1 

bZ=(1-ke)b1 



5903^ 




CONVERSION TO VALE c, ra. y IS 
EXECUTED WITH REVERSE 
DIRECTIONAL VP 


S904 x 

1 ^ 000 ^k WHET 

-<Tdetermi nation 

-^^0R N 
S905 \ 


IS EXECUTED^> 
OT?^ * 

YES 


COUNT -UP CD 







F I G. 9 



S90G 



i 



INCLUSION RATIO 
*=CD/TD(X) 



S907 




NO 



S909 



YES 



COMPRESSION 
RATIO ke 



S910 



$908 n 











ENTIRE IMAGE IS COMPRESSED 
ACCORDING TO VALUE ke 



S911 




COLOR CORRECTION 



S912 



IMAGE DISPLAY 



S913 



IMAGE OUTPUT 



c 



END 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct. 27, 1998 



Sheet 8 of 18 



5,828,780 



CD 




(0 .Q 




TTT 



t t t 



TTT 




TTT 



ccocq 



1^ 



e 



CE CD CO 
t t t 




1 1 f 



TTT 




TTT 





TTT 




TTT 



X>-M 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent Oct. 27, 1998 Sheet 9 of 18 5,828 




FIG. 1 1 C 



FIG. 1 1 D 





100 




































o a *b* plane 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct 27, 1998 



Sheet 10 of 18 



5,828,780 




VARIABLE COMPRESSION FOR EACH 
DIVIDED SPACE IS EXECUTED TO 
COMPRESS REPRESENTATIVE POINT 
(LI. al, bl) TO (Lg. aO, bO) 
WHEN COMPRESSION RATIO IS ke 
AND AUXILIARY RATIO FOR 
DIVIDED SPACE IS ks. 
L2»L-(L-Lg)(1-ke) 
a2=(1-ke)a1 
b2=(1-kc)b1 



S903^ 




CONVERSION. TO 
EXECUTED WITH 
DIRECTIONAL VP 


VALE c. ro. v IS 
REVERSE 




FIG. 12 



S906 



INCLUSION RATIO 
$ =CD/TD(X) 



S90T 



S909 



YES 



COMPRESSION 
RATIO ke 



S910 




NO 



S908 \ 






ke+ 


= 5 




ENTIRE IMAGE IS COMPRESSED 
ACCORDING TO VALUE ke 



S911 



COLOR CO 


RRECTION 


S91 2 \ 




IMAGE DISPLAY 






S913^ 




IMAGE 


OUTPUT 



c 



END 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct 27, 1998 



Sheet 11 of 18 



5,828,780 



FIG. 13 



( 



START 



) 





S1301 > 


USER SPECIFIES REGION FOR TEMPORALLY 
PROCESSING IMAGE 




S1302 > 




SPECIFIED REGION 1 
ACCORDING TO COMPR 


S COMPRESSED 
ESS I ON RATION kfi 



S1303 



COLOR CO 


RRECTION 




SI 304 s 


IMAGE DISPLAY 




YES 



SI 307 



ENTIRE IMAGE IS COMPRESSED 
ACCORDING TO COMPRESSION RATIO ke 



SI 308 



COLOR CO 


RRECTION 




SI 309 ^ 


IMAGE DISPLAY 



c 



END 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct 27, 1998 



Sheet 12 of 18 



5,828,780 



FIG. 14 



SENSOR 1 
SENSOR 2 

* 

SENSOR n 



1 401 



SENSOR OATA 
PROCESSING 
SECT I ON 



ADDRESS TO 
VP 



1402 



VP LIBRARY 



VP PARAMETER 



FIG. 15 



c 
m 
y 




SENSOR 1 
SENSOR 2 

■ ■ 
* 

SENSOR n 



HISTORICAL 

CHANGE/ 

ENVIRONMENT 

CORRECTING 

SECTION 



L*' 
a*' 



03/15/2004, EAST Version: 1.4.1 



4 



U.S. Patent 



Oct. 27, 1998 Sheet 13 of 18 



5,828,780 



FIG. 16 



1600 



^ 



INPUT 
COLOR 
S 1 GNAL 



COLOR CORRECTING 
SECTION 



OUTPUT COLOR 
SIGNAL 



1601 



i 



OUTPUT SECTION 



1602 n 



PARAMETER 
COMPUTING 
SECT I ON 



1603 



1604 





OPTIMIZED COLOR 
DECIDING SECTION 




OPERATING 
SECTION 







03/15/2004, EAST Version: 1.4.1 



U.S. Patent Oct 27, 1998 Sheet 14 of 18 



5,828, 



FIG. 17 



Gamut OF a 
INPUT SIGNAL 




03/15/2004, EAST Version: 1.4.1 



* 



U.S. Patent 



Oct 27, 1998 



Sheet 15 of 18 



5,828,780 



FIG. 18 




FIG. 19 



BLUE SKY 



MOUNTAIN 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct 27, 1998 



Sheet 16 of 18 



5,828,780 



FIG. 2 0 



c 



START 



) 



S2001 _ 

' WHETHER 
CONTROL MODE HAS BEEN SELECTEE 
OR NOT ? 



YES( CENTRAL MODE) 



S2003 



NO(MAXIMUM MODE) 



HISTOGRAM IS FORMED 
ACCORDING TO NUMBER 
OF COLORS USED IN IMAGE 



S2004 



S2002 



COLOR OF CENTRAL PORTION 
OF IMAGE IS DECIDED AS 
OPTIMIZED COLOR 



COLOR SHOWING A MAXIMUM 
VALUE IN HISTOGRAM IS 
DETECTED AND DECIDED AS 
OPTIMIZED COLOR 



S2005 



i 



OPTIMIZED COLOR IS 
INSTRUCTED TO PARAMETER 
COMPUTING SECTION 



c 



END 



) 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent 



Oct 27, 1998 



Sheet 17 of 18 



5,828,780 



FIG. 2 1 



C 



START 



) 





S2101 \ 


Gamut OF INPUT SIGNAL 
DEVICE PREVIOUSLY SET 


AND Gamut OF OUTPUT 
ARE READ 




S2102 ^ 


INSTRUCTED OPTIMIZED COLOR IS READ 




S2103 x 


COLOR REPRODUCTION RANGE IS COMPRESSED 
FROM Gamut OF INPUT SIGNAL AND Gamut OF 
OUTPUT DEVICE ACCORDING TO FIXED POINT 




S2104 -> 


PARAMETERS FOR CORRECTION DEVICE 
ACCORDING TO COMPRESSION OF COLOR 
REPRODUCTION RANGE ARE COMPUTED 




S2105s 


PARAMETERS ARE SET 
SECTION 


IN COLOR CORRECTING 



c 



END 



) 



03/15/2004, EAST Version: 1.4.1 



U.S. Patent Oct 21, im sheet is of is 5,828,780 



FIG. 2 2 



Gamut OF 
INPUT SIGNAL 




03/15/2004, EAST Version: 1.4.1 



5,828,780 



IMAGE PROCESSING APPARATUS WITH 
IMPROVED COLOR CORRECTION 

FIELD OF THE INVENTION 

The present invention relates to an image processing 
apparatus which executes a color correction processing for 
correcting inputted color image data to color image data 
within a range of color rep roduction in a color image out put 
cieviCfe oi* aTOlorcorrection processin g for correctin g input 

BACKGROUND OF THE INVENTION 

In a conventional type of image processing apparatus 
which executes a color correction processing for correcting 
color image data inputted from a color image input device 
such as a scanner or a co mputer within a range of c olor 
reprod uction in a color image output device s uch as a printer, 
or a display unit, when color image data is inputted at a 
position outside the range of c olor rep roductio n in the color 
image output device, a method detecting a position within a 
space of the color reproduction range closest to a position of 
the color image data and outputting a result of detection, or 
a method of reducing a size of the inputted color image data 
toward the center of gravity of the space of the color 
reproduction range described above and outputting the mini- 
mized color image data has been used. 

Also in this case, data modeling a color reproduction 
range of a color image output device (the model is based on 
a division of a three-dimensional space for color 
reproduction) is prepared, and determination as to a color 
reproduction image is made by comparing this model to the 
inputted color image data. 

On the other hand, for compression and color correction, 
an corrected image is practically outputted by a color image 
output device, then a user makes a determination as to 
whether the outputted color image can be accepted or not, 
and if necessary, the user again corrects the color image. 

Also in the conventional technology, once parameters for 
correction are decided taking into consideration the charac- 
teristics of an output device, image processing is executed 
using the same parameters for any image. Generally the 
parameters are decided so that an average of squared errors 
for all colors will be minimized, but the colors include those 
having a small error or those having a large error, and 
sometimes the colors having a large error may be important 
for a pattern of the image. For this reason, in an output 
device frequently used for outputting human images, some- 
times parameters are decided putting a priority in for skin 
color. 

However, with the conventional technology as described 
above, a determination is made by comparing data modeling 
a color reproduction range in a color image output device to 
inputted color image data, so that it is necessary to appro- 
priately prepare data modeling a color reproduction range 
according to each type of color image output device, and for 
this reason construction of processing for determination is 
disadvantageously complicated. Especially in case of a 
system in which a color image output device connected to an 
image processing device can easily be replaced with a new 
one, it is required to change various types of parameter 
previously set and used for processing for determination 
each time, which is very troublesome. 

Also with the conventional technology as described 
above, processing for determination is executed for all 
pixels constituting color image data, and for this reason a 
long time is required for the processing. 
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In the method of reducing a size of inputted color image 
data toward the center of gravity of a space of a color 
reproduction range as employed in the conventional 
technology, if most of the inputted color image data is 
5 included in the space of color reproduction range, color 
image data included in the color reproduction range space is 
changed in the non-color direction due to the effect by data 
of a few pixels data outside the color reproduction range, so 
that the output image as a whole may become not so 
10 attractive and also the color attractiveness of the entire 
image may be lost. 

With the conventional technology as described above, 
furthermore when the method of reducing a size of a color 
image toward the center of gravity of a color reproduction 
range space is employed, a reduction ratio is automatically 
decided, so that it is not always possible to obtain a color 
image the user takes a fancy for. 

In addition, with the conventional technology described 
above, when a color image input device or a color image 
output device connected thereto is replaced with a different 
one, or when a color image output device changes as time 
goes by or due to some environmental factors, rapid coun- 
termeasures can not be taken. 

Also in case of an output device required to frequently 
process human images, if parameters are decided taking a 
skin color seriously, an error to colors used to an image other 
than a human image may becomes larger, which is also 
unadvantageous for optimal color processing. Namely it is 
impossible to select parameters most suited to a pattern to be 
reproduced. Also if a color reproduction range (gamut) for 
an input signal is wider than that in an output device, as 
shown in FIG. 22, a color reproduction range for an output 
signal is reduced homogeneously, so that even portions of an 
image having colors to be reproduced accurately are 
reduced, causing a problem of color displacement. 

SUMMARY OF THE INVENTION 

It is a first object of the present invention to make it 
possible to easily construct parameters used for making a 
determination as to whether inputted color image data is 
within a colo i_iep ro_duction range of a colo r image output 
device or not as well as to easily execute processing foF 
dete rmination^ " ~* 

It is a second object of the present invention to make it 
possible to realize jiigh speed p rocessing for determination 
as well as to prevent the entire color image from losing the 
color attractiveness due to effect by data of a few pixel data 
outside the color reproduction range. 

It is a third object of the present invention to prevent 
general entire color attractiveness from being lost because of 
compression of a color image. 

It is a fourth object of the present invention to make it 
possible for a user to set an allowable reduction ratio so that 
the user can obtain a color image the user takes a fancy for. 

It is a fifth object of the present invention to make it 
possible to rapidly take necessary means against historical 
changes or changes due to environmental factors in a 
connected color image output device or when a connected 
color image input device or a color image output device is 
replaced with another one. 

It is a sixth object of the present invention to enable color 
correction most suited to an image pattern. 

It is a seventh object to enable automatic color correction 
65 most suited to an image pattern. 

In order to achieve the object as described above, an 
image processing apparatus according to the present inven- 
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tion executes processing in a direction reverse to that in a 
color image output apparatus with a virtual device means 
and makes a deter mination as to whether input col or-image 
data is wit hin a color reproduction ran g e in the col prJmage 
out put device acco £dine4»^utpuLcokiLim a ge data from the 
virtual device_Qi^arisjyLth.a_discrimmatiiig.mcaii^ 

An image processing apparatus according to the present 
invention enables high speed computing by dividing p 



homogeneous color s pace into a plurality of regions witb^ 
inputted coloFimage data present in each re g ion re presented 
by one representative data for each regio n and using the 
'representative data"(representative point of an ima ge). Also 
the-image-processing apparatus counts a number of pixels in 
input col or image d ata present in a region tor eachjeg ion. 
makes a determination as to wnetber the representative dat a 
is Within a color r eproduction range of a color image outpu t 
device or not, obtains a ratio of a total number of pixels 
corresponding "to representative data ojsmmiriairdlirouT - 
side the color reproduction range and a number of all pixels 
in*tKe"inputied color image, and linearly reduces a size of the 
inputted color image data when the obtained ratio exceeds a 
specified value (threshold value). 

An image processing apparatus according to the present 
invention reduces loss of color attractiveness when a size of 
an image is reduced by increasing a compression ratio more 
to data further from a reference point for compression by 
enabling change of a compression ratio for each region with 
a linear compression means. 

An image processing apparatus according to the present 
invention executes linear comp ression , when a user sets a 
compression ratio with a compression ratio setting means, to 
input color image data using th e compression ratio,, ana also 
executes linear compression to input color image data in 
other cases according to a compression ratio decided by a 
compression ratio deciding mean s, so that a user can reduce 
a size of an ima g e according to a compression ratio having 
an allowable value^ ~ " 

An image processing apparatus according to the present 
invention reduces loss of color attractiveness when a size of 
an image is reduced by computing a compression ration for 
each region and increasing a compression ratio more to data 
further from a reference point for compression with a size 
reduction ratio deciding means. 

An image processing apparatus according to the present 
invention monitors historical changes or changes due to 
environmental factors in a color image output device, selects 
appropriate parameters from a plurality of parameters pre- 
viously set taking into considerations historical changes or 
changes due to environmental factors in the color image 
output device, executes processing in a direction reverse to 
that in the color image output device with a virtual device 
means, and makes a determination as to whether input color 
image data"is'wi thin"a"cdlbr reproduction ran ge„in_the.color.- 
image outpuFdevice or not according to output color image 
data- from- the" virtu al ~de vice~me ans~ wi th'a" dis^iminating 
means. 

An image processing device according to the present 
invention executes processing in a direction reverse to that 
in a color image output device with a virtual device means. 
Also the image processing device measures historical 
changes or those due to environmental factors in a color 
image output device, corrects output color image data 
obtained through processing in the reverse direction 
described above according to a result of measurement, and 
makes a determination as to whether input color image data 
is within a color reproduction range in the color image 
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output device or not according to the output color data after 
correction with a discriminating means. 

An image processing apparatus according to the present 
invention selects colors in input image data with an oper- 
ating means and executes color correction most suited to an 
image pattern by computing with a parameter computing 
means parameters according to the colors selected by the 
operating means. 

An image processing means according to the present 
invention can automatically execute color correction most 
suited to an image pattern because the operating means 
selects colors in a central section of an input image consist- 
ing of input image data. 

An image processing device according to the present 
invention can automatically execute color correction most 
suited to an image pattern because the operating means 
selects colors in a region having the largest area in the input 
image consisting of input image data. 

Other objects and features of this invention will become 
understood from the following description with reference to 
the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a system block diagram illustrating a _color 
digital im age composing apparatus incorporating an image 
processing ap paratus according to the present invention ; 

FIG. 2 A is an explanatory view illustrating a relation 
between a color reproduction range in an image output 
device and object image data; 

FIG. 2B is an explanatory view illustrating a relation 
between a color reproduction range in an image output 
device and object image data; 

FIG. 2C is an explanatory view illustrating a relation 
between a color reproduction range in an image output 
device and object image data; 

FIG. 2D is an explanatory view illustrating a relation 
between a color reproduction range in an image output 
device and object image data; 

FIG. 3 is a flow chart illustrating a method of preparing 
a virtual image output device VP; 

FIG. 4 is an explanatory view illustrating an example of 
configuration of a virtual image output device VP; 

FIG. 5 is a flow chart of an operation for making a 
determination as to whether input color image data is within 
a color reproduction range of a color image output device or 
not using the virtual image output device VP (reverse 
direction VP) constructed with a neural network shown in 
FIG. 4; 

FIG. 6 is an explanatory view illustrating divided spaces 
in Embodiment 2; 

FIG. 7 is an explanatory view showing L*a*b* in FIG. 6 
seen from just above and illustrating a representative value 
of a divided space; 

FIG. 8 is a flow chart for an operation for deciding a 
compression processing comprising steps of saving repre- 
sentative values for each divided space, counting a number 
of pixels in each divided space, computing an inclusion ratio 
a, and making a determination as to whether compression is 
required or not; 

FIG. 9 is a flow chart for an operation for compression in 
Step S812 in FIG. 8; 

FIG. 10 is an explanatory view showing an image data 
flow in each of Steps S911 to S913 in FIG. 9; 

FIGS, Wa^d are an explanatory view illustrating an 
operation for setting an auxiliary compression ratio in 
Embodiment 3; 
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FIG. 12 is a flow chart for compression in Embodiment 3; 

FIG. 13 is a flow chart illustrating a portion of compres- 
sion processing in Embodiment 4; 

FIG. 14 is an explanatory view illustrating an sample of 
configuration for decision of VP parameters in Embodiment 
5; 

FIG. 15 is an explanatory view illustrating an example of 
configuration in Embodiment 6; 

FIG. 16 is a block diagram illustrating an example of 
configuration in Embodiment 7; 

FIG. 17 is an explanatory view illustrating compression of 
a color reduction range or the like in Embodiment 7; 

FIG. 18 is an explanatory view illustrating a case where 
central mode for Embodiment 7 is selected; 

FIG. 19 is an explanatory view illustrating a case where 
the maximum mode for Embodiment 7 is selected; 

FIG. 20 is a flow chart illustrating a control operation by 
an optimized color deciding means in Embodiment 7; 

FIG. 21 is a flow chart illustrating a control operation by 
a parameter computing means in Embodiment 7; and 

FIG. 22 is an explanatory view for compression of a color 
reproduction range or the like in the conventional technol- 
ogy. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Description is made for a case in which an image pro- 
cessing apparatus according to the present invention is 
applied to a color digital image composing apparatus in the 
order of [Embodiment 1], [Embodiment 2\ [Embodiment 
3], [Embodiment 4], [Embodiment 5], [Embodiment 6], and 
[Embodiment 7] with reference to the related drawings. 

FIG. 1 is a system block diagram illustrating a color 
digital image comp osin g apparatus incorporating the image" 
pr ocesarig^p paTatusaccordi ng to"me_pt'esitPU n^^tioTrTrie' 
color digital image composing apparatus is a system con- 
structed byjidding ja color facsim ile facility with a commu- 
nicating func tion or a lar ge ca pacity storage device Jo a 
conventional type of digital color copying machine. Herein 
description is made for general configuration of the system 
shown in FIG. 1. Connected to a system bus 100 for delivery 
of control signals or image data are an image reader 101 for 
fetching images as digital data such as a scanner, an image 
output device 102 for forming images on paper or OHP sheet 
such as a printer, an image display device 103 for displaying 
and checking images such as a monitor, a memory device 
104 such as a hard disk or a magneto-optical disk, an ' 
operating/input device 105 for inputting or displaying 
instructions or parameters for processing for a device, a 
control device 106 for controlling each device, an image 
processing device (an image processing device according to 
the present invention) 107 for processing or editing digital 
image data, a communication device 108 for connection 
with a communication network for executing such opera- 
tions as coding or decoding, and an external I/F (interface) 
109 for connection with an external device such as a 
computer. 

With the configuration above, next description is made for 
operations thereof in the following order; 

(1) relation between object image data and a color repro- 
duction range in the image output device 102 

(2) construction of a virtual device (VD) in the image 
processing apparatus 107 

(3) processing as to whether input image data is within a 
color reproduction range or not. 
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(1) Relation Between Object Image Data and a Color 
Reproduction Range in the Image Output Device 102 

When processing an image in the image processing appa- 
ratus 107, object image data (input color image data) is 
classified to image data prepared on the image display 
device 103 (such, for instance, computer graphics image 
data), and that read by the image reader 101 (such as, for 
instance, RGB data for common color copy, or negative 
data). 

Generally image data prepared on the image display 
device 103 often includes colors having high brightness and 
high chromaticity not included in the original picture or 
printed material due to an area of a color reproduction range 
of the image display device 103 itself. For this reason, a 
large volume of image data exceeding a color reproducing 
capability of the image output device 102 for outputting 
colors is present, so that, when the object is image data 
prepared on the image display device 103, image processing 
to the type of image is required. 

As the maximum color reproducing capability of the 
image output device 102 in the system shown in FIG. 1 is 
fixed, it is necessary to compare a color reproduction range 
for object image data to that of the image output device 102 
when outputting the object image data with the image output 
device 102. Namely it is necessary to make a determination 
to what extent the object image data is included in a color 
reproduction range of the image output device 102. 

FIG. 2Ato FIG. 2D each show a relation between a color 
reproduction range in the image output device 102 and 
object image data. When it is tried to display a color space 
of object image data in a homogeneous color space (a color 
space is concentrated into a space), the result is largely 
classified as follows. It should be noted therein that in the 
figure the reference numeral 200 indicates a color reproduc- 
tion range in the image output device 102 for a homoge- 
neous color space CIELAB while the reference numeral 201 
indicates a color space of the object image data. 

As shown in FIG. 2A, a color space 201 of the object 
image data is included in a color reproduction range 200. 

As shown in FIG. 2B, the color reproduction range 200 is 
included in the color space 201 of the object image data. 

As shown in FIG. 2C, a portion of the color space 201 of 
the object image data is included in the color reproduction 
range 200. 

As shown in FIG. 2D, the color space 201 of the object 
image data is not included in the color reproduction range 
200. 

FIG. 2 A shows a case where the color space 201 of the 
object image data is included in the color reproduction range i 
of the image output device 102, and in this case the object 
image data can be outputted as it is, so that the object image 
data can be outputted through normal color processing (such 
as conversion of R G B to C*M Y). In FIG. 2B to FIG. 2D, 
however, a region outside the color reproduction range 200 
is included, so that it is necessary to execute processing for 
virtually narrowing a color reproduction range for the color 
space 201 of the object image data (This processing is called 
^compression processing hereinafter). 
60 The present invention relates to a determination as to 
whether the compression, processing as described abo ve 
shou ld be executed or not^a nd more particularly makes it 
possib le to easily __cj3nstnict .parameters jised'w henLajfleter- 
minauon as to whether obj ect ima ge jatajs^wjthin.a.color 

65 reproducti^^ran ^inlhTima ge^ut put device 102_o mot.is . 

executed' as well as to easily execute the deter mination 
above: " " " 
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(2) Construction of a Virtual Device (VD) in the Image 
Processing Device 107 

Next description is made for a virtual devic e (VD) used • 
for a determinationas to whe ther object image data is with in 
a~color repro duction range ofaiTimage outpuTcievice or not. 5 
In'EmbVdiment 1, a virtual image outpurdevice"(VPrVirtua] 
Printer)js constructed an d used as a virtual deWce"mTEe^ 
ima ge processin g apparatu s 107 shown in FIG - 17 
"FIG. 3 is a flow chart illustrating a meth"o~d"bf forming a 
virtual image output device VP. At first, N pieces of color 10 
sample are outputted from the actual image output device 
102 (S301). Herein 4 patches of color sample comprising 
three single colors of C, M, and Y and a mixed color in 
which C, M, and Y are mixed are treated as one set, and a 
number of sets are outputted so that the maximum color ' 15 
reproduction range of the image output device 102 will be 
obtained. 

' Then density c, m, and y of each of the three patches of 
outputted color sample (three-color printer for c, m, and y 
assumed in this embodiment) and an L*a*b* value for the 20 
mixed color are measured (S302), and parameters for the 
virtual image output device VP are computed with a neural 
network using these values as input and output (S303). It 
should be noted that herein parameters in a case where input 
in a neural network is c, m, and y and output is L*a*b* are 25 
called regular directional VP, and those in a case where input 
and output are inverted are called reverse directional VP. 

FIG. 4 shows an example of configuration of the virtual 
image output device VP, which is herein built with a neural 
network using b ack propagation therein. The neural network 30 
"comprises an input layer having an input number p, inter- 
mediate layers 1, 2 each having an element q, and an output 
layer having an output number r In the present invention, p 
and r are 3 respectively. Also the above parameters p, q, and 
r are decided so that the I/O values will become minimum 35 
ones. 

By using computed parameters, in a regular directional 
VP, an L*a*b* value expected to be actually outputted from 
given c, m, and y density data is obtained. Therefore, for 
reverse directional VP, by inputting the L*a*b* within a 40 
color reproduction range of the image output device 102, 
values for c, m, and y, which are solutions thereof, are also 
within the measured density data. In other_words. when 
given image data is converted to L*~a*b*^jfjhe_j^ue_is 
outside the color reproduction range ^of "the image' out put 45 
device~102 raTleast one of the solutions for c, m, and y is out 
of the measured density data. For this rea son..itJ s_ possible 
Jojaaj^a_detecrflinatipn as to whether_g iven image da ta.is 
wit hin a color reproduction range of the image output device 
102 or not. ~~ ' 50 

Also when reverse directional VP is obtained between 
RGB and L*a*b*, against L*a*b* input outside the color 
reproduction range, at least one solution among the output 
values for R, G, and B is negative or a value larger than 255 
(in a case where each value for R, G, and B consists of 8 55 
bits), similar ly it is possible to make a determinati on.as_to 
whether given data is withi n a color reproduction range of 
the'i nTage~on tpu t~dcvicc~ 102 or not.. 

(3) ~Processing-as-to-Whetrier Image Data is Within a Color 
Reproduction Range or Not 60 

Next description is made for an operation for making a 
determ ination as to whethe r image data is within a color 
r eproduction ran ge of ^image^utput"device or not by using 
a virtual image o utput device V P (reve rse~di rectional VP) 
'builrwith a neural network shown in FIG. 4 with reference 65 
to the flow chart shown in FIG. 5. At first, image data (RGB 
data) is converted to a tristimulus value XYZ (S501), and 
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XYZ is converted to L*a*b* (S502). Then values for c, m, 
and y are computed with reverse directional VP by a virtual 
image output device VP (S503). 

Then a determination as to whether all the computed 
values for c, m, and y are within a measured colo r density 

^rarjge^of the image output device 102 or not is executed 
(S504), and if the values are within the measured densit y 
range, i tjs^e telTnme^Thinh"e~image da t a is within a color 
reproductio n range^f the image outputH evice 102 (S505). 

"Un the other hand, if the val ues are outside tEe measured 
density range, it is determined uiatjhe _imag g!9a*ta is outs ide 
of the color reproduction rangelhe image output device 102 
(S506). 

Thus, after the determination as to whether given data is 
ojitrmi> color reproduction range of the image output device 
102 or not is executed, if it is determined that the image data 
is outside the color reproduction range of the image output 
device 102 (the relation shown in FIG. 2B to FIG. 2D), 
compression pro cessin g for the object image data is 
exec utedT ail^'^ata is convert ed so that the image data will 
bT"wilhiiTthe color repr oduction~range of'm e~ima'g'e~outp ut 
device 102. 

iJEmbOdiment 1, as shown above, processing for reverse 
directional VP against the image output device 102 is 
executed by a virtual image output device VP, and a deter- 
mination as to whether all the values for c, m, and y (input 
color image data) is within the measured density range (i.e., 
the color reproduction range of the image output device 102) 
or not is executed in step S504 so that the operation for 
determination can easily be executed. As a virtual image 
output device is constructed by also using a neural network, 
it is possible to easily construct parameters used for a 
determination as to whether object image data is within a 
color reproduction range of the image output device 102. 
Also it is possible to easily change parameters. 

In relation to Embodiment 1, as shown in FIG. 5, a case 
was described in which a determination as to whether object 
image data is within a color reproduction of the image output 
device 102 or not is executed and then compression pro- 
cessing is executed if the object image data is outside the 
color reproduction image of the image output device 102, 
but if the determination is executed to all the pixels in the 
object image data when it is decided whether the compres- 
sion processing is to be executed or not to be executed, the 
computing load in reverse directional VP becomes larger, 
and a long time may be required for the determination if the 
image is large. So in Embodiment 2, a hgrnogeneous color 
space is divided to a plurality of regions, and"object"image 
data present in each region is represented by one represen- 
tative data to execute high speed computing by using the 
representative data (a representative point for the image). 
Also a number of pixels in input color image data present in 
a region are computed for each region, a determination as to 
whether the representative data is within the color repro- 
duction range of the image output device 102 or not is 
executed, a ratio of the total number of pixels corresponding 
to the representative data recognized as outside the color 
reproduction range vs the total number of pixels in the object 
image data is obtained, and when the obtained ration 
exceeds a specified value (threshold value), linear compres- 
sion is executed to the object image data. 

It should be noted that configuration of Embodiment 2 is 
the same as that in Embodiment 1, so that illustration and 
description thereof are omitted herein. 

In Embodiment 2, at first, as shown in FIG. 6, a wide color 
space completely including a color reproduction range 600 
of the image display device 103 as well as that of the image 
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output device 102 is previously divided to ixjxk pieces of 
space (called divided space hereinafter) in the direction of 
each axis of L*a*b*, and a number of pixels included in each 
divided space is obtained for all pixels. 

Herein assuming conditions for the wide color space 5 
above as follows; 



b^Sb'Sb 



so that, when input values for a pixel are L0, aO, bO, 
coordinates for the corresponding divided space Sd can be 
decided as 



10 



division pitches PL, Pa, Pb for each axis are obtained 
through the following expressions; i$ 



PL-iL^-L^fi 



20 



25 



Sd=(int (LO/PL), int(aO/Pa), int (b0/Pb)) 

(It should be noted that a section below decimal point for int 
( ) is rounded down). 30 

Then, a pixel counter (not shown) corresponding to the 
divided space Sd counts up by one. When counting up first 
in a divided space, the L*a*b* value is saved together with 
the coordinates Sd of the divided space. When counting of 
all pixels in a corresponding divided space is finished, a 35 
determination is made as to whether the entire divided space 
is within the color reproduction range or not. The L*a*b* 
value used for the determination above is represented by the 
center of gravity of the divided space or one of vertexes of 
the rectangular parallelepiped, and the determination is 40 
executed to all the divided spaces. 

With this operation, as shown in FIG. 7, only the repre- 
sentative value 703 for the divided space corresponding to 
the object image data is left. FIG. 7 shows the L*a*b* in 
FIG. 6 seen from the above, and in this figure a*b* is divided 45 
to jxk pieces of spaces. When distribution of the object 
image data is as shown at 701, a space in which the 
representative value 703 in each divided space 702 is as 
shown by the shadowed area. Each representative value 703 
for the shadowed space is saved. 50 

Then depending on the L*a*b* saved for all the divided 
spaces in the shadowed area, a determination as to whether 
object image data is within a color reproduction range of the • 
image output device 102 or not is executed according to the 
same sequence as that described in relation to Embodiment 55 
1 . Concretely, this operation is executed according to a loop 
from A in FIG. 5. Then the total sum IP of all pixels 
belonging to divided spaces recognized as within the color 
reproduction range is obtained, and an inclusion ratio a 
(=IP/TP) is computed from the total sum IP and the total 60 
number of pixels TP in the object image data, and compres- 
sion processing is executed wben the inclusion ratio a 
exceeds the threshold value Th previously set. 

Herein the threshold value Th .is set to prevent an image 
with almost all the pixels included in a color reproduction 65 
rage from being compressed due to a few pixels outside the 
reproduction range. 



FIG. 8 shows a flow chart for operations deciding com- 
pression processing compressing steps for saving a repre- 
sentative value for each divided space above, a count of 
pixels in each divided space, computing the inclusion ration 
a, and making a determination for the necessity of com- 
pression processing. At first an image processing apparatus 
107 makes a determination as to whether processing for all 
pixels TP in object image data is over or not (S801), and the 
sequence from step S802 to S806 is repeated until process- 
ing has been executed to all the pixels TP. If processing has 
been executed for all the pixels TP, then the system control 
goes to the step S807. 

In steps S802 to S806, a pixel (RGB data) is converted to 
tristimulus value XYZ (S802), XYZ is converted to L*a*b* 
(S803), counting up for a divided space to which the L*a*b* 
belongs is executed (S804), and coordinates for the space 
and L*a*b* value are saved (S806) in case of initial count 
up for the divided space (namely if it is first count up) 
(S805). 

In step S807, a determination as to whether the determi- 
nation has been executed to all the divided spaces or not is 
executed. If not, a determination as to whether the corre- 
sponding spaces are within the color reproduction range or 
not is executed, and if the divided spaces are within the color 
reproduction range (S808), the total sum IP of all the pixels 
belonging to the divided space is obtained (S809), and 
control returns to step S807. 

If the determination has been executed to all the divided 
spaces, the inclusion ratio a (=IP/TP) is obtained (S810), the 
inclusion ratio a is compared to the threshold value Th 
(S811), and if a is equal to or larger than Th, compression 
processing is executed (S812). On the other hand, if a is 
smaller than Th, a non-compression processing is executed 
(S813). 

It should be noted that the non-compression processing is 
an operation for normal image processing other than the 
compression processing (in steps S911 to S913 described 
later and shown in FIG. 9). 

Then description is made for the compression processing 
in step S812 in FIG. 8 with reference to the flow chart in 
FIG. 9. In the compression processing, a representative point 
(LI, al, bl) which is a representative value for each of all 
the divided space TD where the image is present is linearly 
compressed to a point (Lg, aO, bO). Herein, assuming that Lg 
is, for instance, 50 and the compression ratio is ke, the 
coordinates (L2, a2, b2) after compression can be obtained 
through the following expressions; 



L2~L-£-Lg) (l-ite) 
a2=(l-fa) al 
M-(l-te) bl 

Then a number of representative points CD included in the 
color representative range of the image output device 102 is 
obtained, and also the inclusion ratio p (=CD/TD) is 
obtained (S901 to S906). 

It should be noted that the compression ration ke for the 
initial time is set to a small value and the compression ratio 
is made gradually larger by adding a pitch 6 to the com- 
pression ratio ke until the inclusion ratio (3 becomes larger 
than the threshold value Thd (S907, S908, S901 to S906). 

When the inclusion ratio fi becomes larger than the 
threshold value Thd, the compression ratio ke then is 
decided as a compression ratio to be used (S909), and the 
entire image is compressed according to the value (S910). 
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Then a color correction is executed (S911), image display 
is executed on the image display device 103 (S912), and the 
image is outpuited onto recording paper through the image 
output device 102 (S913). 

FIG. 10 shows an image data flow in each processing in 5 
steps S911 to S913, and in this figure, the arrow (T) shows 
color correction and image display, while the arrow (5) 
indicates image output. In case of recording paper (for 
printed material, pictures or the like), the image is read as " 
RGB digital data by the image reader 101 through correction 10 
CCs. As the CG image or the like is prepared by using such 
a device as the image display device 103, it is originally 
RGB data. 

This RGB data is converted to a tristimulus value XYZ 
through a 3x3 determinant aij, and is furthermore converted 15 
to Lab (L*a*b*) through the function f( ). Then Lab 
(L*a*b*) is compressed through compression processing to 
LW, and is returned to a tristimulus value X'YZ 1 through 
the function g( ). Then densities for c, m, and y are obtained 
through correction CCp in the image output device 102, then , 20 
the density values are subjected to y conversion for correct 
the gray color to obtain c', m', and y', which are converted 
to L'V'b" by a virtual image output device VP, the values 
being subjected to conversion through the function g( ) to 
obtain X"Y"Z" and also to conversion through the inverse is 
matrix bij to obtain R'B'G'. 

Namely, the R'B'G' is virtual image formation obtained as 
output from the actual device (image output device 102) by 
a virtual image output device VP. This sequence of opera- 
tions is color processing. Also to display R'B'G' on the image 30 
display device 103 is image display. When actually output- 
ting the image onto recording paper, c'm'y* after y conversion 
is switched as indicated by the arrow (2), a nd is passed 
through a conve rsion table LUT for transmission to the 
image output device 102. This operation is image output. 35 
"FO"3ata"t6"and from a virtual image output device VP can 
be constructed in addition to the density values for c,m and 
y as in the present invention, as an integral value for a 
reflection factor for each single color or RGB data. As data 
forming a pair therewith, also data other than L*a*b* is 40 
allowable. Also the I/O data can be constructed by a three- 
color system for cmy or a four-color system of cmyk, and in 
that case, it is necessary to change color processing accord- 
ing to the I/O data. 

As described above, in Embodiment 2, in addition to 45 
effect in Embodiment 1, an operation for determination can 
be executed at a higher speed, and also it is possible to 
prevent color attractiveness of a color image from being lost 
due to effect by data of a few pixels outside the color 
reproduction range. Also loss of color attractiveness due to 50 
compression of a color image can be prevented. 

It should be noted that, as a method of dividing a space, 
a dividing method in which a width of division becomes 
larger as a position of division goes further from a reference 
point in one axial direction may be employed in addition to 55 
homogeneous division. 

Embodiment 3 is different from Embodiment 2 in the 
point that a way of division can be changed according to 
each divided space. It should be noted that the basic con- 
figuration and operations thereof are the same as those in 60 
Embodiment 2 and description is made for only different 
portions thereof. 

In Embodiment 2, as shown in FIG. 11A, divided spaces 
each including a wider color space are set. In Embodiment 
3, as shown in FIG. 11 B, an auxiliary compression ratio is 65 
previously set for each of the regions shown as 4 stages in 
the figure so that a compression ratio becomes higher as a • 
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region goes further from the origin in the direction of 
saturation. Also an auxiliary compression ratio is set in the 
L* axis as shown in FIG. 11C and FIG. 11D with (Lg, 0,0) 
as the center. Description is made for the auxiliary com- 
pression ratio. For instance, in FIG. UB, the auxiliary 
compression ratio is set with 4 steps, and assuming that the 
auxiliary compression ratio corresponding to each level is kO 
to k3 as a step goes further from the center, when the 
compression ratio is ke, a compression ratio for each space 
computed with a*b* is k (1-ke), kl (1-ke), k2 (1-ke), and 
K3 (1-ke). 

It should be noted that an auxiliary compression ratio for 
each step is adjusted for the corresponding divided space not 
to enter. Assuming that the compression ratio is 20%, and 
also assuming that k0-l, kl-0,875, k2-0.75, k3-0.625, as 
ke is 0.2, so that a product of each auxiliary compression 
ratio by (1-ke) is 0.8, 0.7, 0.6, and 0.5 respectively. From the 
compression ratio is 20%, 30%, 40% and 50% respectively 
from the inner side. 

FIG. 12 shows a flow chart for compression processing in 
Embodiment 3, and the compression processing is basically 
the same as that in Embodiment 2 shown in FIG. 9, and the 
same reference numeral indicates the same processing, so 
that herein description is made for only different portions. 
Variable compression for each the divided spaces is 
executed to compress a representative point (LI, al, bl) 
which is a representative value foe each of all the divided 
space TD where the image is present to a point (Lg, aO, bO) 
(S1201). Herein assuming that Lg is, for instance, 50, the 
compression ratio is ke, and the auxiliary compression ratio 
for the divided space is Ks, coordinates (L2, a2, b2) after 
compression can be obtained as described below. 

LUL-<t-Lg) (l-*e) ks 
a2=(l-jte) teal 
W-(l-Jfec) JfcrM 

Then, like in Embodiment 2, a number of representative 
points CD included in a color reproduction range of the 
image output device 102 is obtained, and then the inclusion 
ratio P (-CD/TD) is obtained (S901 to S906). 

As described above, in Embodiment 3, by making a 
compression ratio for each region variable in linear com- 
pression by setting an auxiliary ratio so that a compression 
ratio for data further from a reference point for compression 
becomes larger, it is possible to reduce loss of color attrac- 
tiveness when an image is compressed. In other words, it is 
possible to present color attractiveness of the entire image 
from being lost when a color image is compressed. 

In Embodiment 4, the steps S910 to S 9 12 enclosed by a 
dotted line in the flow chart for compression processing in 
Embodiment 3 are replaced with steps S1301 to S1309 
shown in FIG. 13. 

In Embodiment 3, a compression ratio is automatically 
computed to execute image display and image output, but 
some users may hope clearly outputting a high density 
section more than preventing the general color attractiveness 
from being deteriorated. For this reason, in Embodiment 4, 
a user can select a compression ratio kef to be applied finally 
to the image data with reference to the compression ratio ke 
as a reference for compression. 

At first, when a user specifies a region for temporally 
processing an image for checking a state after compression 
processing with an operating/input device 105 (S1301), the 
specified region is compressed according to the compression 
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ratio ke ($1302), color correction is executed (S1303), and 
image display is executed (S1304). The user checks this 
image displayed on the image display device 103, and sets 
a compression ratio ke through the operating/input device 
105 if the image does not have a desired color tone (S1305, 
S1306). Then, control returns to step S1302, wherein the 
specified region is compressed according to the specified 
compression ratio ke, and then the sequence after step S1303 
is repeated. 



torical change as library data, and when an address for VP 
parameter is inputted from the sensor data processing sec- 
tion 1401, a corresponding VP parameter is outputted. 

The virtual image output device VP shown in FIG. 10 
executes processing for reverse directional VP using VP 
parameters outputtcd from the VP library 1402, and virtually 
makes an image satisfying the current conditions of the 
image output device 102. 

In Embodiment 5, as described above, necessary mea- 



On the other hand, if the displayed image is a desired one, 10 sures can rapidly be taken against historical changes or 

the user presses down a specified key on the operating/input environmental changes in a connected image output device, 

device 105 to instruct completion of compression ratio Also, for instance, even if a connected image output device 

setting (S1305), when the entire image is compressed is replaced with a new one, optimal VP parameters are 

according to the compression ratio kef which is the com- automatically selected according to sensor data of a newly 

pression ratio ke then (S1307), color correction is executed 15 installed image output device, so that optimal image com- 

(S1308), and image display is executed (S1309). pression processing can be executed. 

In Embodiment 4, as described above, when a user sets a In Embodiment 6, to execute optimal processing accord- 
compression ratio through the operating/input device 105 ing to historical changes or environmental changes, in 
(compression ratio setting means), linear compression is addition configuration in Embodiment 1 to Embodiment 4, 
executed to the image data according the compression ratio, 20 a group of sensors (sensor 1 to sensor n) each for measure- 
and in other cases, linear compression is executed to the ment of historical changes and environmental changes and a 
image data according to a compression ratio automatically historical change/environment correcting section 1501 for 
decided, so that, in addition to effects in Embodiment 3, correcting image data (L*a*b*) after processing by the 
image compression can be carried out according to a com- virtual image output device VP according to sensor data 
pression ratio having a value acceptable to the user. In other 25 from the group of sensors above are provided. 



words, a user can set a compression ratio acceptable to the 
user, the user can obtain a color image the user takes a fancy 
for. 

The image output device 102 does not always provide the 
same output to a constant input (CMY data). This phenom- 
enon occurs because of historical change of the image output 
device 102 and changes in environmental factors when 
output is provided. Also causes for historical changes are 
classified to those causing long term, medium term, and 
short term changes. In case of, for instance, a copying 
machine, representative causes include changes in a feed 
rate of toner or voltage loaded to a photosensitive drum. 

In Embodiment 5, in addition to configuration in Embodi- 
ment 1 to Embodiment 4, a sensor for measuring historical 



Input density values for c, m, and y are converted to 
L*a*b* by the virtual image output device VP. Then sensor 
data is fetched in and corrected data L*'a*'b*' is obtained by 
the historical change/environment correcting section 1501. 
30 With Embodiment 6, as described above, necessary mea- 
sures can rapidly be taken against historical changes or 
environmental changes in a connected image output device. 
Also, for instance, even if a connected image output device 
is replaced with a new one, image data is corrected accord- 
35 ing to sensor data form a newly installed image output 
device, so that optimal image compression processing can 
be executed. 

Description is made for general configuration of Embodi- 
ment 7 with reference to FIG. 16, A color correcting section 



changes as described above, and a sensor for measuring 40 1600, which is a color correction circuit, executes color 
environmental factors (such as a humidity sensor) are pro- correction to an inputted input color signal according to 
vided in the image output device 102, so that an image parameters set previously, and outputs as an output color 
satisfying current conditions of the output machine (image signal. An output section 1601, which is a printer, records an 
output device 102) can virtually be made by using the sensor . image on recording paper according to the inputted output 
data measured by the sensors to the virtual image output 45 color signal. A parameter computing section 1602, which is 



device VP. 

Concretely the image output device 102 is provided in an 
environmental room, where image output is executed or 
historical change is generated by carrying out, for instance, 
an acceleration test, and sensor data is measured. 

Then the sensor data is classified to several cases accord- 
ing to types of environmental change and historical change, 
VP parameters are computed for each case, and are compiled 
into a library for storage. 



a parameter computing section, uses an optimized color 
instructed as a fixed point as shown in a color space in FIG. 
17, compresses a color reduction range or computes param- 
eters from a gamut of an input signal as well as from a gamut 
so of an output device each set previously according to this 
fixed point, and sets parameters in the color correcting 
section 1600. 

An optimized color deciding section 1603, which is an 



optimized color deciding circuit, decides either a color of the 

And most suited VP parameters are extracted from the 55 central portion of the image such as a face as shown in FIG. 

sensor data obtained during the actual operation, and are 18 or a color of a portion having the maximum area such as 

used for image processing. a blue sky as shown in FIG. 19 as an optimized color 

FIG. 14 shows an example of configuration for deciding according to an instruction, and gives an instruction as the 

VP parameters in Embodiment 5. When sensor data is optimized color to the parameter computing section 1602. 

inputted from a sensor group (sensor 1 to sensor n) provided 60 An operating section 1604, which is an operating panel, has 



in the image output device 102, a sensor data processing 
section 1401 makes a determination as to situation of 
environmental or historical changes according to the sensor 
data, and outputs an address for each VP parameter suited to 
the situation discriminated as described above. Stored in a 
VP library 1402 are VP parameters previously classified to 
several cases according to types of environmental or his- 



65 



a switch provided therein for selecting the central mode in 
which a color of the central portion of an image is specified 
as an optimized color or the maximum mode in which a 
color of a portion having the maximum area is specified as 
an optimized color and gives an instruction of either mode 
to the optimized color deciding section 1603 with usually 
the central mode selected. 
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Next description is made for controlling operations by the image from being lost due to effect by data of a few pixels 

optimized color deciding section 1603 with reference to the outside the color reproduction range, 

flow chart shown in FIG. 20. At first an instructed mode is The image processing device according to the present 

detected, namely a determination as to whether the central device can changes a compression ratio for each region with 

mode has been selected or not is made (S2001). In step s * linear compression unit and make a compression ratio 

S2001, if it is determined that the central mode has been lat B er 10 data mrther from a reference point for compression, 

selected, a color of the central portion of an image is decided 50 that lt * possible to reduce loss of color attractiveness 

as an optimized color (S2002). On the contrary, if it is ^ m ima S e 15 compressed. 

determined that the cental mode has not been selected in . ™ e ."^ Pressing apparatus according to the present 

* P^ftm i -r*u • it * , , . invention executes, when a user sets a compression ratio 

step S2001, namely if the maximum mode has been selected 10 ^ a (essfan ralio ^ um% i me ar compression 

a histogram is formed according to a number of colors used tQ ^ colof ^ data ^ ^ rati0j and 
in the image (S2003). Then, a color showing a maximum also executes m othe r cases linear compression to input 
value in the histogram (a color of a portion having the c£)lor image dala accor ding t0 a compression ratio decided 
maximum area in the image) is detected and decided as an by ^ compression rat i 0 deciding unit, so that it is possible 
optimized color (S2004), gives an instruction for the opti- 15 to set a compression ratio acceptable to a user and to obtain 
mized color to the parameter computing section 1602 a co i or i mage tne us er takes a fancy for. 
(S2005), and then terminates the operational sequence. The image processing apparatus according to the present 
Next description is made for controlling operations by the invention can compute a compression ratio for each region 
parameter computing section 1602 with reference to the flow with the compression ratio deciding unit and make a corn- 
chart in FIG. 21. At first, gamut of an input signal and that 20 pression ratio larger for data further from a reference point 
of an output device previously set are read (S2101), and then for compression, so that it is possible to reduce loss of color 
the instructed optimized color is read (S2102). Then the attractiveness when an image is compressed, 
optimized color is used as a fixed point as shown in a color The image processing apparatus according to the present 
space in FIG. 17, and a color reproduction range is com- invention measures historical changes or environmental 
pressed from the gamut of the input signal and that of the 25 chan S es m a 00101 ima S e 0Ut P ut device > °P timal 
output device according to this fixed point (S2103). Then, parameters from a plurality of parameters previously set 

c . , - , , j * - taking into consideration the historical chances of or envi- 

parameters for correction decided according to compression fe " , r , . * 4 i , . 

r f , j . * _ „ „^^oin^ n ~A »u A ronmental changes for the color image output device, 

of a color reproduction range are computed (S2104), and the ? . ,. » #u * • *u i 

r . - tU i *• *• i^rtn executes processing in a direction reverse to that in the color 

parameters are set in the color correcting section 1600 . * * j • -*v i a • a ^ 

fc>ift*\ ™ una S e output device with a virtual device, and makes a 

O2105). 30 determination with a discriminating unit as to whether input 

There are various methods of compressing a color repro- colof dala ^ g color reproductkm range of a 

duction range, such as a method in which the brightness and color image output device or not accor ding to color image 

saturation are homogeneously compressed with the hue data omput ted from the virtual device, so that necessary 

unchanged, or a method in which a color reproduction range measures can rapidly be taken when a connected color 

is assumed as an elastic body and the image is subjected to . 35 image input device or a color image output device is 

elastic deformation, and any other method may be available. replaced with a new one, or against historical changes of or 

As a method of computing parameters, for instance, the least environmental changes for a connected color image output 

square method in which there is a restriction that the fixed device. 

point is a minimum error may be used. The image processing device according to the present 

As described above, the image processing apparatus 40 invention executes processing with a virtual device in a 

according to the present invention executes processing in a direction reverse to that in a color image output device. Also 

direction reverse to that in a color image output device with the image processing apparatus measures historical changes 

a virtual device, and makes a determination as to whether of or environmental changes for a color image output device, 

input color image data is within a color reproduction range corrects output image data obtained through processing in 

of the color image output device or not according to color 45 the reverse direction described above according to a result of 

image data outputted from the virtual device, so that it is measurement above, and makes a determination with a 

possible to easily construct parameters used for a determi- discriminating unit as to whether input color image data is 

nation as to whether input color image data is within a color within a color reproduction range of a color image output 

reproduction range of a color image output device or not and device or not according to the output color image data after 

also to easily execute the determination. 50 correction, so that necessary measures can rapidly be taken 

The image processing device according to the present when a corrected color image input device or a color image 

invention divides a homogeneous color space into a plurality output device is replaced with a new one, or against histori- 

of regions, has color image data present in each region cal changes of or environmental changes for a connected 

represented by one representative data, and uses the repre- color image output device. 

sentative data (a representative point of the image), so that 55 The image processing apparatus according to the present 
high speed computing can be executed. Furthermore the invention selects colors in input image data with an oper- 
image processing device counts a number of pixels in input ating unit, and computes parameters with a parameter corn- 
color image data present in a region for each region, makes puting unit according to colors selected by the operating 
a determination as to whether the representative data is unit, so that it is possible to execute color correction most 
within a color reproduction range of a color image output 60 suited to an image pattern. 

device or not, obtain a ratio of the total number of pixels The image processing apparatus according to the present 

corresponding to the representative data recognized as out- invention selects with an operating unit a color of the central 

side the color reproduction range vs a number of all pixels portion of an input image comprising input image data, and 

in the input color image data, and executes a linear com- also selects a color of a portion having the maximum area in 

pression to the input color image data when the obtained 65 an input image comprising input image data, so that it is 

ratio exceeds a specified value (threshold value), so that it is possible to execute color correction most suited to an image 

possible to prevent general color attractiveness of a color pattern. 
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Although the invention has been described with respect to 
a specific embodiment for a complete and clear disclosure, 
the appended claims are not to be thus limited but are to be 
construed as embodying all modifications and alternative 
constructions that may occur to one skilled in the art which 5 
fairly fall within the basic teaching herein set forth. 

What is claimed is: 

1. An image processing apparatus comprising: 

a virtual device for receiving input color image data, for 
executing processing in a direction reverse to that in a 10 
color image output device, and for outputting output 
color image data based on said input color image data, 
said output color image data being in the color space of 
color image data input into said output color device, 
said color space having a plurality of dimensions; 15 

a discrimination unit for making a determination as to 
whether said input color image data is within a color 
reproduction range according to individual compari- ' 
sons of values of said output color image data from said 
virtual device in each of said dimensions in the color 20 
space and respective ranges in the color space of the 
color image output device; and 

a color corrector for correcting the input color image data 
to be within the color reproduction range of the color 
image output device according to said determination 
that the input color image data is within the color 
reproduction range of the color image output device. 

2. An image processing apparatus comprising: 
a virtual device for receiving input color image data, for 

executing processing in a direction reverse to that in a 
color image output device, and for outputting output 
color image data based on said input color image data, 
said output color image data being in the color space of 
color image data input into said output color device, 
said color space having a plurality of dimensions; 
a discrimination unit for making a determination as to 
whether said input color image data is within a color 
reproduction range according to individual compari- 
sons of values of said output color image data from said 
virtual device in each of said dimensions in the color 
space and respective ranges in the color space of the 
color image output device; 

an operating unit for selecting a color in said input color 
image data; 

a parameter computing unit for computing parameters 
according to a color selected by said operation unit; and 

a color corrector for correcting the input color image data 
using said parameters to be within the color reproduc- 
tion range of the color image output device according 50 
to said determination that the input color image data is 
within the color reproduction range of the color image 
output device. 

3. An image processing apparatus according to claim 2, 
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said input color image data present in each region 
represented by one representative data; 

a pixel number counting unit for counting a number of 
pixels in said input color image data present in a region 
for each said region; 

a discriminating unit for making a determination as to 
whether said representative data is within a color 
reproduction range of said color image output device; 

a ratio computing unit for computing a ratio of the total 
number of pixels corresponding to representative data 
Discriminated by said discriminating unit as not inside 
the color reproduction range vs a number of all pixels 
in said input color image data; and 

a linear compression unit for executing linear compres- 
sion to said input color image data when the ratio 
obtained by said ratio computing unit exceeds a speci- 
fied value. 

6. An image processing apparatus according to claim 5, 
wherein said linear compression unit can change a compres- 
sion ratio for each said region. 

7. An image processing apparatus comprising: 

a color corrector for executing color correction for cor- 
recting input color image data using parameters so that 
the input color image data will be within a color 
reproduction range of a color image output device; 

an image data representing unit for dividing a homoge- 
neous color space into a plurality of regions and having 
said input color image data present in each region 
represented by one representative data; 

a pixel number counting unit for counting a number of 
pixels in said input color image data present in a region 
for each said region; 

a discriminating unit for making a determination as to 
whether said representative data is within a color 
reproduction range of said color image output device; 

a ratio computing unit for computing a ratio of the total 
number of pixels corresponding to representative data 
discriminated by said discriminating unit as not inside 
the color reproduction range vs a number of all pixels 
in said input color image data; 

a linear compression unit for executing linear compres- 
sion to said input color image data when the ratio 
obtained by said ratio computing unit exceeds a speci- 
fied value; 

an operating unit for selecting a color in said input color 
image data; and 

a parameter computing unit for computing parameters 
according to the color selected by said operating unit. 

8. An image processing apparatus according to claim 7, 
wherein said linear compression unit can change a compres- 
sion ration for each said region. 

9. An image processing apparatus according to claim 7, 



wherein said operating unit selects a color at the central 55 wherein said operating unit select a color of the central 



portion of an input image comprising input color image data. 

4. An image processing apparatus according to claim 2, 
wherein said operating unit selects a color of a portion 
having the maximum area in an input image comprising 
input color image data. 

5, An image processing apparatus comprising: 

a color corrector for executing color correction for cor- 
recting input color image data using parameters so that 
the input color image data will be within a color 
reproduction range of a color image output device; 

an image data representing unit for dividing a homoge- 
neous color space into a plurality of regions and having 



portion of an input image comprising input color image data. 

10. An image processing apparatus according to claim 7, 
wherein said operating unit selects a color of a portion 
having the maximum area in an input image comprising 

60 input color data. 

11. An image processing apparatus comprising: 

a color corrector for executing color correction for cor- 
recting input color image data so that the input color 
image data will be within a color reproduction range of 
65 a color image output device; 

an image data representing unit for dividing a homoge- 
neous color space into a plurality of "regions and having 
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said input color image data present in each region 
represented by one representative data; 

a pixel number counting unit for counting a number of 
pixels in said input color image data present in a region 
for each said region; 

a discriminating unit for making a determination as to 
whether said representative data is within a color 
reproduction range of said color image output device; 

a ratio computing unit for computing a ratio of the total 
number of pixels corresponding to representative data 
discriminated by said discriminating unit as not inside 
the color reproduction range vs a number of all pixels 
in said input color image data; 

a compression ratio deciding unit for deciding through a 
computing sequence previously set when the ratio 
obtained by said ratio computing unit exceeds a speci- 
fied value; 

a compression ratio setting unit for a user to set a 
compression ratio; and 

a linear compression unit for executing linear 
compression, when a compression ratio is set by said 
compression ratio setting unit, to said input color image 
data using the compression ratio and also executing 
linear compression to said input color image data in 25 
other cases according to a compression ratio decided by 
said compression ratio deciding unit. 

12. An image processing apparatus according to claim 11, 
wherein said compression ratio deciding unit computes a 
compression ratio for each said region. 

13. An image processing apparatus comprising: 

a color corrector for executing color correction for cor- 
recting input color image data using parameters so that 
the input color image data will be within a color 
reproduction range of a color image output device; 

an image data representing unit for dividing a homoge- 
neous color space into a plurality of regions and having 
said input color image data present in each region 
represented by one representative data; 

a pixel number counting unit for counting a number of 
pixels in said input color image data present in a region 
for each region; 

a discriminating unit for making a determination as to 
whether said representative data is within a color 
reproduction range of said color image output device; 

a ratio computing unit for computing a ratio of the total 
number of pixels corresponding to representative data 
discriminated by said discriminating unit as not inside 
the color reproduction range vs a number of all pixels 
in said input color image data; 

a compression ratio deciding unit for deciding through a 
computing sequence previously set when the ratio 
obtained by said ratio computing unit exceeds a speci- 
fied value; 

a compression ratio setting unit for a user to set a 
compression ratio; 

a linear compression unit for executing linear 
compression, when a compression ratio is set by said 
compression ratio setting unit, to said input color image 
data using the compression ratio and also executing 
linear compression to said input color image data in 
other cases according to a compression ratio decided by 
said compression ratio deciding unit, 

an operating unit for selecting a color in said input color 
image data; and 
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a parameter computing unit for computing parameters 
according to the color selected by said operating unit. 

14. An image processing apparatus according to claim 13, 
wherein said compression ratio deciding unit computes a 
compression ratio for each said region. 

15. An image processing apparatus according to claim 13, 
wherein said operating unit selects a color of the central 
portion of an input image comprising input color image data. 

16. An image processing apparatus according to claim 13, 
wherein said operating unit selects a color of a portion 
having the maximum area in an input image comprising 
input color image data. 

17. An image processing apparatus comprising: 

a virtual device for receiving input color image data, for 
executing processing in a direction reverse to that in a 
color image output device, and for outputting output 
color image data based on said input color image data, 
said output color image data being in the color space of 
color image data input into said output color device, 
said color space having a plurality of dimensions; 

a discrimination unit for making a determination as to 
whether said input color image data is within a color 
reproduction range according to individual compari- 
sons of values of said output color image data from said 
virtual device in each of said dimensions in the color 
space and respective ranges in the color space of the 
color image output device; 

a color corrector for correcting the input color image data 
to be within the color reproduction range of the color 
image output device according to said determination 
that the input color image data is within the color 
reproduction range of the color image output device; 
and 

a measuring unit for measuring historical changes of or 
environmental change for said color image output 
device. 

18. An image processing apparatus according to claim 17, 
wherein said virtual device selects optimal parameters from 
a plurality of parameters previously set taking into consid- 
erations historical changes of or environmental changes for 
said color image output device according a result of mea- 
surement by said measuring unit, and executes said process- 
ing in the reverse direction. 

19. An image processing apparatus comprising: 

a virtual device for receiving input color image data, for 
executing processing in a direction reverse to that in a 
color image output device, and for outputting output 
color image data based on said input color image data, 
said output color image data being in the color space of 
color image data input into said output color device, 
said color space having a plurality of dimensions; 

a discrimination unit for making a determination as to 
whether said input color image data is within a color 
reproduction range according to individual compari- 
sons of values of said output color image data from said 
virtual device in each of said dimensions in the color 
space and respective ranges in the color space of the 
color image output device; 

a measuring unit for measuring historical changes of or 
environmental change for said color image output 
device; 

an operating unit for selecting a color in said input color 
image data; 

a parameter computing unit for computing parameters 
according to a color selected by said operation unit; and 

a color corrector for correcting the input color image data 
using said parameters to be within the color reproduc- 
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tion range of the color image output device according 
to said determination that the input color image data is 
within the color reproduction range of the color image 
output device. 

20. Am image processing apparatus according to claim 
19, wherein said virtual device selects optimal parameters 
from a plurality of parameters previously set taking into 
considerations historical changes of or environmental 
changes for said color image output device according a 
result of measurement by said measuring unit, and executes 
said processing in the reverse direction. 

21. An image processing apparatus according to claim 19, 
wherein said operating unit selects a color of the central 
portion of an input image comprising input color image data. 

22. An image processing apparatus according to claim 19, 
wherein said operating unit selects a color of a portion 
having the maximum area in an input image comprising 
input color image data. 

23. An image processing apparatus comprising: 

a virtual device for receiving input color image data, for 
executing processing in a direction reverse to that in a 
color image output device, and for outputting output 
color image data based on said input color image data, 
said output color image data being in the color space of 
color image data input into said output color device, 
said color space having a plurality of dimensions; 

a discrimination unit for making a determination as to 
whether said input color image data is within a color 
reproduction range according to individual compari- 
sons of values of corrected output color image data 
from said virtual device in each of said dimensions in 
the color space and respective ranges in the color space 
of the color image output device; 

a color corrector for correcting the input color image data 
to be within the color reproduction range of the color 
image output device according to said determination 
that the input color image data is within the color 
reproduction range of the color image output device; 

a measuring unit for measuring historical changes of or 
environmental change for said color image output 
device; and 

a correcting unit for correcting said output color image 
data obtained through said processing in the reverse 
direction as said corrected output color image data 
according to a result of measurement by said measuring 
unit. 
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24. An image processing apparatus comprising: 

a virtual device for receiving input color image data, for 
executing processing in a direction reverse to that in a 
color image output device, and for outputting output 
5 color image data based on said input color image data, 
said output color image data being in the color space of 
color image data input into said output color device, 
said color space having a plurality of dimensions; 

10 a discrimination unit for making a determination as to 
whether said input color image data is within a color 
reproduction range according to individual compari- 
sons of values of said corrected output color image data 
from said virtual device in each of said dimensions in 

15 the color space and respective ranges in the color space 
of the color image output device; 

a measuring unit for measuring historical changes of or 
environmental change for said color image output 
device; 

a correcting unit for correcting said output color image 
data obtained through said processing in the reverse 
direction as said corrected output color image data 
according to a result of measurement by said measuring 
25 unit; 

an operating unit for selecting a color in said input color 
image data; 

a parameter computing unit for computing parameters 
according to a color selected by said operation unit; and 

a color corrector for correcting the input color image data 
using said parameters to be within the color reproduc- 
tion range of the color image output device according 
to said determination that the input color image data is 
35 within the color reproduction range of the color image 
output device. 

25. An image processing apparatus according to claim 24, 
wherein said operating unit selects a color of the central 
portion in an input image comprising input color image data. 

40 26. An image processing apparatus according to claim 24, 
wherein said operating unit selects a color of a portion 
having the maximum area in an input image comprising 
input color image data. 
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